Suggested Hand Gesture Lexicon
For Medical Image Navigation Application
In The Operating Room


Below is an appropriate set of gestures which can be used for Medical Image Navigation in the Operating Room. System actions were initially mapped with gestures in the Jester Dataset . The improved set of gestures are determined based on the results of the Hand Gesture Evaluation Survey conducted and from a previous study by Jacob et al.
System Action Hand Gesture Notes
Application Status
Unlock Application Thumb Up Thumb Up, other fingers tucked in. If there are added functionalities for confirmation, this gesture would be more appropriate for agreeing or answering yes.
Lock Application Thumb Down Thumb Down, other fingers tucked in. If there are added functionalities for confirmation, this gesture would be more appropriate for disagreeing or answering no.
Series Navigation
Go To Previous Series Swipe Up Palm facing upward. Smaller movement of four fingers pivoting upward.
Go To Next Series Swipe Down Palm facing downward. Smaller movement of four fingers pivoting downward.
Series Image/Slice Navigation
Go To Previous Image In The Series Swipe Left Palm facing camera or side. Move hand to the left.
Go To Next Image In The Series Swipe Right Palm facing camera or side. Move hand to the right.
Series Animation
Play Series Swipe Down (Side View) Side view of the hand facing screen. Palm facing downward. Smaller movement of four fingers pivoting downward.
Play Series In Reverse Swipe Up (Side View) Side view of the hand facing screen. Palm facing upward. Smaller movement of four fingers pivoting upward.
Stop Playing Series Stop Sign Open hand palm Facing Screen.
Panning
Pan Up Slide Two Fingers Up Point index and middle finger. Move hand or two fingers upward.
Pan Down Slide Two Fingers Down Point index and middle finger. Move hand or two fingers downward.
Pan Left Slide Two Fingers Left Point index and middle finger. Move hand or two fingers towards the left.
Pan Right Slide Two Fingers Right Point index and middle finger. Move hand or two fingers towards the right.
Brightness Manipulation
Increase Brightness Push Hand Away Palm facing camera, move open hand towards camera. Taken from Jacob et al
Decrease Brightness Pull Hand In Back of hand facing camera, move open hand away from camera.
Orientation Manipulation
Rotate Counter-clockwise Swipe Counter-clockwise Palm facing camera, wave hand to the left (counter-clockwise). Taken from Jacob et al
Rotate Clockwise Swipe Clockwise Palm facing camera, wave hand to the right (clockwise). Taken from Jacob et al
Zoom Level Manipulation
Zoom In Open Two Fingers Index and thumb touching initially, other fingers tucked in. Move index and thumb away from each other.
Zoom Out Close Two Fingers Index and thumb away from each other initially, other fingers tucked in. Move index and thumb towards each other until they touch.